Having thus described the invention, it is now claimed: 

1. A system for organizing multi-dimensional panern data into a reduced- 
dimension representation comprising: 

a neural network comprised of a plurality of layers of nodes, the 
plurality of layers including: 

an input layer comprised of a plurality of input nodes, 
a hidden layer, and 

an output layer comprised of a plurality of non-linear output 
nodes, wherein the number of non-linear output nodes is less than the number of input nodes; 

receiving means for receiving multi-dimensional pattern data into the 
input layer of the neural network; 

output means for generating an output signal for each of the output nodes 
of the output layer of the neural network corresponding to received multi-dimensional pattern 
data; and 

training means for completing a training of the neural network, wherein 
the training means includes means for equalizing and orthogonal izing the output signals of the 
output nodes by reducing a covariance matrix of the output signals to the form of a diagonal 
matrix. 
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2. A system according to claim 1, wherein said training means uses 
backpropagation to iteratively update weights for the links between nodes of adjacent layers. 



3. A system according to claim 2, wherein said weights are generated 
randomly in the interval (W, -W). 

4- A system according to claim 3, wherein averaged variance of all 
dimensions of the multi-dimensional pattern data is: 

1 ^ ^ 

V. = — T^Ya^^ -<x>f 

in V ,p t ^ 

or i=i p=i 

,and the elements of the covariance matrix of the output signals of the output nodes are defined 
by: 

V V. (O, -<0 >)((9, -<0,>) 

out.k^k^ p Z— / ^ k^p k^p k^ ^ 

, where p = l,2,...,P ; 

(9. is the output signal of the kjth node of the output layer for the pth input data 
pattern vector; 

^ is the output signal of the kjth node of the output layer for the pth input data 
pattern vector; 
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<Oj^ > is the average of (9^^ evaluated over the set of input data pattern vectors 
<Oj^ > is the average of O^^ evaluated over the set of input data pattern vectors 

ki = l to K ; 
k2=l to K ; 

K is the number of dimensions in the reduced-dimension representation; and 
< > denotes the mean evaluated over the set of input data pattern vectors for each 
indicated component. 

5. A system according to claim 4, wherein weights Aw^j between the 
hidden layer and the output layer are iteratively updated according to the expression: 




, where ri is a constant of suitable value chosen to provide efficient convergence but to avoid 
oscillation; 
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Ojp is Ihe output signal from the jth node in the layer preceeding the output layer due to 
the pth input data pattern vector; 
E is the error given by: 



K K 



and. 



'Jfc k 



V -r V 
QutM kk in 

r V 

'^kk^ in 



,where - kz = k; k - 1,...,K; and is a positive constant which has an effect of increasing the 
speed of training. 



in 



.where k2>ki; k,= l.,..,K-l; k2=k, + l,...,K; and is a positive constant which has an 
effect of increasing the speed of training; and 

6fcp = 8kp , + \z + *kp.3 .where 6^, is a value proportional to the contribution to the 
error E by the outputs of the kth node of the ou^ut layer, for the pth input data pattern vector, 
and 6^.1 ^b^^ > ^kp.J components of 6^, . 
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6. A system according to claim 5, wherein: 



dE.. 1 ^ 



kpj jp 



kj,2 



- -riE 



K dE 



kk. 



JP 



k-\ dE, . 1 P 

aw,, p,^ 



JP 



where mv^.^^^ is the contribution from the diagonal terms of the covariance matrix of the outputs, 
AWjt^ 2 the contribution from the off-diagonal terms in /cth row, 
^^kj3 is the contribution from the off-diagonal terms in kth column, and 
Ojp is the ouput signal from the jth node in the layer preceeding the output layer for the 

pth input data pattern vector. 
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7. A system according to claim 6, wherein: 




, where 

is the output signal from the kth node in the output layer for the pth input data 
pattern vector, and 

<Ojjp> is the average of Oj^ evaluated over the set of input data pattern vectors. 



8. A system according to claim 5, wherein backpropogation of error to the 
weights AWjj between the jth node in a layer of nodes and the ith node in its' preceeding layer: 
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where, 5 is given by: 



6. = 

JP 



E6 



O. (1 -(9. ) 



9- A method for effecting the organization of multi-dimensional pattern 
data into a reduced dimensional representation using a neural network having an input layer 
comprised of a plurality of input nodes, a hidden layer, and an output layer comprised of a 
plurality of non-linear output nodes, wherein the number of non-linear output nodes is less 
than the number of input nodes, said method comprising: 

receiving multi-dimensional pattern data into the input layer of the neural 

network; 

generating an output signal for each of the ouput nodes of the neural 
network corresponding to received multi-dimensional pattern data; and 

training the neural network by equalizing and orthogonalizing the output 
signals of the output nodes by reducing a covariance matrix of the output signals to the form of 
a diagonal matrix. 
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10. A method according to claim 9, wherein said step of training includes 
backpropagation to iteratively update weights for links between nodes of adjacent layers. 

11. A method according to claim 10, wherein said weights are generated 
randomly in the interval (W, -W). 

12. A method according to claim 11, wherein averaged variance of all 
dimensions of the multi-dimensional pattern data is: 

,and the elements of the covariance matrix of the output signals of the output nodes is: 

, where p=l,2,...,P ; 

is the output signal of the kith node of the output layer for the pth input data 

pattern vector; 

o. is the output signal of the k^th node of the output layer for the pth input data 
pattern vector; 
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<0 > is the average of 0, evaluated over the set of input data pattern vectors 



kj = l toK; 
ki=l toK; 

K is the number of dimensions in the reduced-dimension representation; and 
< > denotes the mean evaluated over the set of input data pattern vectors for each 
indicated component. 



hidden layer and the output layer are iteratively updated according to the expression: 



<0. > is the average of O 



evaluated over the set of input data pattern vectors 



13. A method according to claim 12, wherein v/eights Aw^j between the 




dE 



Z_/ I kp ji 




= Aw 



+ Aw 



+ Aw 



, where ri is a constant of suitable value chosen to provide efficient convergence but to avoid 



oscillation; 
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Ojp is the output signal from the jth node in the layer preceeding the output layer, due 



to the pth input data pattern vector; 
E is the error given by: 



K K 



k 

^2 



and. 



out,kk kk in 



V 



kk m 



,where kj = k2 = k; k = 1,...,K; and t^^ is a positive constant which has an effect of increasing the 
speed of training. 



V 



\ 



out,k^k^ 



V. 

in 



, where k2>k,; kj = 1,...,K-1; k2=-ki4-l,...,K; and r^^^^ is a positive constant which has an 

effect of increasing the speed of training; and 

= 6^ J + 6^^2 + 6,^^3 , where 5^^ is a value proportional to the contribution to the 
error E by the outputs of the kth node of the output layer, for the pth input data pattern vector, 
and 6,,p J ,6^p 2 , and b^^ -^ are components of 
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14. A method according to claim 13, wherein: 

^^11 1 A 



pZ^ I kp,2 jp 



kj,3 



A-1 dE. , , p 



7W 



Pp-l 



kp,3 Jp 



where aWj^^j is the contribution from the diagonal term, 

^^kja is contribution from the off-diagonal terms in Ath row, and 
AH'jjy^ is the contribution from the off-diagonal teims in k\h column. 



by. 



15. A method according to claim 14, wherein 5j^^j, 6j^^2 ^kp3 given 



K 



, where 

is the output signal from the kth node in the layer preceeding the output layer for the 
pth input data pattern vector, and 

<0^> is the average of O^^ evaluated over the set of input data pattein vectors. 

16. A method according to claim 13, wherein backpropogation of error to 
the weights Awj, between the jth node in a layer of nodes and the ith node in its' preceeding 
layer are: 
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Aw..=ri =— >^ "no. X. 



where, 6 is given by: 




' w,. O, (1 ~0, ) 



I 



\ 



17. A system for organizing multi-dimensional pattern data into a reduced 
dimensional representation comprising: 

a neural network comprised of a plurality of layers of nodes, the 
plurality of layers including: 

an input layer comprised of a plurality of input nodes, and 
an output layer comprised of a plurality of non-linear output 
nodes, wherein the number of non-linear output nodes is less than the number of input nodes; 

receiving means for receiving multi-dimensional pattern data into the 
input layer of the neural network; 

output means for generating an output signal at the output layer of the 
neural network corresponding to received multi-dimensional pattern data; and 
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training means for completing a training of the neural network, wherein 
the training means conserves a measure of the total variance of the output nodes, wherein the 
total variance of the output nodes is defined as: 



, where {xp )is a set of data pattern vectors; 
p=l,2,...,P; 

P is defined as a positive integer; 
<x,> denotes the mean value of of x^p evaluated over the set of data pattern 

vectors; 

S is the number of dimensions; 

x,p is the ith component of Xp, the pth member of a set of data pattern vectors. 

18. A system according to claim 17, wherein said training means completes 
the training of the neural network via backpropagation for progressively changing weights for 
the output nodes. 
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19. A system according lo claim 18, wherein said training means further 

includes, 

means for training the neural network by backpropagation by 
progressively changing weights Wj^j at the output layer of the neural 
network in accordance with, 

, where Opj is the output signal from the jth node in the layer preceeding the output layer due 
to the pth data pattern, 

rj is a constant of suitable value chosen to provide efficient convergence but to avoid 
oscillation, and 

Spk ^5 ^ value proportional to the contribution to the error E by the outputs of the kth 
node of the output layer for the pth input data pattern. 

20. A system according to claim 19, wherein: 

q n 
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21. A system according to claim 19, wherein said neural neiworK runner 
comprises at least one hidden layer comprised of hidden nodes, wherein adaptive weights Wjj 
for each hidden node is progressively improved in accordance with, 



Aw.. = -ri 



dE 



1 



, where Op; is the output signal for the ith node of the layer preceeding the jth layer of the pth 
input data pattern. 

22. A system according to claim 21, wherein: 



6 .= 
pj 



Pk kj 



O i\ -O .) 
pr py 



23. A method for effecting the organization of multi-dimensional pattern 
data into a reduced dimensional representation using a neural network having an input layer 
comprised of a plurality of input nodes, and an output layer comprised of a plurality of non- 
linear-output nodes, wherein the number of non-linear output nodes are less than the number 
of input nodes, said method comprising: 
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receiving a set {Xp} of data panern vectors into the input layer ot the 
neural network, wherein p = l>2,,..,P and wherein P is defined as a positive integer, and 
wherein the set of data pattern vectors has a total variance defined as, 



p = l i = l 

, where {Xp } is a set of data pattern vectors; 
p = l,2,...,P; 

P is defined as a positive integer; 

<Xj> denotes the mean value of of Xjp evaluated over the set of data pattern vectors; 
S is the number of dimensions; 

Xjp is the ith component of Xp, the pth member of a set of data pattern vectors; 

training the neural network by backpropagation; and 

displaying a multi-dimensional output signal from the output layer of the 

neural network. 
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24. A method according to claim 23, wherein said step of training the neural 
network by backpropogaiion includes progressively changing weights Wj^j at the output layer of 
the neural network in accordance with, 

, where Opj is the output signal from the jth node in the layer preceeding the output layer due 
to the pth data pattern, and 

r| is a constant of suitable valure chosen to provide efficient convergence but to avoid 
oscillation. 

6p^ is a value proportional to the contribution to the error E by the outputs of the kth 
node of the output layer for the pth input data pattern. 

25, A system according to claim 24, wherein: 

q n 
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26. A method according to claim 23, wherein said neural network further 
comprises at least one hidden layer comprised of hidden nodes, wherein adaptive weights w 
for each hidden node of the neural network is progressively improved in accordance with. 



. dE 1^^ . ^ 



, where Op, is the output signal for the ith node of the layer preceeding the jth layer of the pth 
input data pattern. 

27. A method according to claim 26, wherein 



6 .= 
PJ 



E8 



pk kj 
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28. A method according to claim 23, wherein said multi-dimensional output 
signal is a two-dimensional output signal. 

29. A metiiod according to claim 23, wherein said two-dimensional output 
signal includes data points plotting in relation to 2-dimensional axes. 
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